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Abstract. Using coalgebraic methods, we extend Conway's theory of games to possibly 
non-terminatmg, i.e. non-wellfounded gam,es {hypergam,es) . We take the view that a play 
which goes on forever is a draw, and hence rather than focussing on winning strategies, we 
focus on non-losing strategies. Hypergames are a fruitful metaphor for non-terminating 
processes, Conway's sum being similar to shujfling. We develop a theory of hypergames, 
which extends in a non-trivial way Conway's theory; in particular, we generalize Conway's 
results on game determinacy and characterization of strategies. Hypergames have a rather 
interesting theory, already in the case of impartial hypergames, for which we give a com- 
positional semantics, in terms of a generalized Grundy- Sprague function and a system of 
generalized Nim games. Equivalences and congruences on games and hypergames are dis- 
cussed. We indicate a number of intriguing directions for future work. We briefly compare 
hypergames with other notions of games used in computer science. 



1. Introduction 

This paper arises from our attempt of understanding games using very foundationally un- 
biased tools, namely algebraic and coalgebraic methods. Of course, games arising in real life 
are extremely varied. They exhibit indeed a perfect example of a family resemblance in the 
sense of Wittgenstein. Furthermore, in the past decades people have gone into the habit 
of describing, more or less conveniently, an extremely wide gamut of interactions and other 
dynamic phenomena using game-based metaphors. To make matters even more complex 
when we speak about games many related concepts and notions come about, e.g. move, 
position, play, turn, winning condition, payoff function, tactics, strategy. None of these 
has a universal unique meaning, and according to the various presentations, these concepts 
are often blurred, sometimes taken as primitive sometimes explained and reduced to one 
another. And there are many more properties, which need to be specified more or less 
informally before actually having pinned down the kind of game one is interested in; e.g. 
perfect knowledge, zero-sum, chance, number of players, finiteness, determinacy. 
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We think that Conway's approach to games provides a very elementary and sufficiently 
abstract notion of game, which nonetheless is significantly structured, because of the special 
role that sums of games have in Conway's theory. And algebraic-coalgebraic methods 
provide a convenient conceptual setting for addressing this key concept. 

For these reasons, in this paper, we focus on Conway games |Con76j . that is combina- 
torial games, namely no chance 2-player games, the two players being conventionally called 
Left (L) and Right (R). Such games have positions, and in any position there are rules 
which restrict L to move to any of certain positions, called the Left positions, while R may 
similarly move only to certain positions, called the Right positions. L and R move in turn, 
and the game is of perfect knowledge, i.e. all positions are public to both players. The game 
ends when one of the players has no move, the other player being the winner, the payoff 
function yielding only or 1. Many games played on boards are combinatorial games, e.g. 
Nim, Domineering, Go, Chess. Games, like Nim, where for every position both players 
have the same set of moves, are called impartial. More general games, like Domineering, 
Go, Chess, where L and R may have different sets of moves are called partizan. 

Many other notions of games such as those which arise either in Set Theory, or in 
Automata Theory, or in Semantics of Programming Languages can be conveniently encoded 
in coalgebraic format, see [HLRlla] . 

Here are some of the most frequently asked questions and corresponding arguments. 

Which concept should be taken as primitive: moves or positions? We think that one of 
the strong points of Conway's format is that of focusing on positions. Actually, in Conway's 
theory, games, positions and moves essentially coincide. This approach is more general than 
others. Of course, the situation is much nicer when positions can be inductively defined 
as finite sequences of more elementary tokens, namely moves, and hence positions can be 
viewed as special kinds of plays, or vice versa. 

Why do we need both a notion of Player L and Player R, which in turn can be either 
Player I, the first player, or Player II, the respondent? Conway's choice arises from the 
fact that, as we pointed out above, a key ingredient in his theory is that of sum of games. 
In Conway's approach there is a rigid alternation of moves between the two players in a 
sum game, but if we focus on a specific component of a sum game this might no longer be 
so: the notions of first player and respondent in a subgame can change many times, and 
even a strict alternation of moves breaks down. This is in general why one can only refer 
meaningfully to player L or R, notwithstanding the fact that any of the two can make an 
opening move in the game. 

Of course many games where alternation of players is not rigid escape a direct encoding 
in Conway's games. However, in some cases these can be easily encoded in a coalgebraic 
format, as in some presentations of automata games, where alternation of players is not 
assumed, see [HLRlla] . Sometimes, encodings are more roundabout, as in some card 
games, where the alternation between L and R is determined by a precise criterion, or as in 
normal form games, arising in economic theory, and in morra, where the two players play 
simultaneously. 

Conway's approach clearly does not address the issue of a payoff function. Furthermore, 
since the winning condition is the absence of possible moves, i.e. no next positions to reach 
for the player whose turn is on, some encoding is necessary to account for many games 
where winning or losing depends on the sequence of positions, or moves. There are many 
games of this kind. Some are rather silly, such as "My father is richer than yours" where 
the two players in turn call a number and who call the largest is the winner. Some are less 
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silly such as the one where the two players call two numbers in turn and the first player 
wins if the sum is equal to, say, 1 mod 4. Some are extremely important, such as those 
which arise in Set Theory, in connection with the Axiom of Determinacy, or in Automata 
Theory, where we have to deal, however, with infinite plays. 

This is the last item we address: finite or infinite plays. One of the main contributions 
of this paper is the study of non-terminating (non-wellfounded) games, i.e. games on which 
plays are potentially infinite. Especially in view of applications, potentially infinite inter- 
actions are even more important than finite ones. The importance of games for Computer 
Science comes from the fact that they capture in a natural way the notion of interaction. 
Non-wellfounded games model in a faithful way reactive processes (operating systems, con- 
trollers, communication protocols, etc.), that are characterised by their non-terminating 
behaviour and perpetual interaction with their environment. 

We take the "natural" view that all infinite plays are draws: on infinite plays, ap- 
parently, there are no losers, because each player can respond indefinitely. This naturally 
extends the winning condition on Conway's games. In this paper, in fact, we shall address 
only games were all infinite plays are draws, i.e. "free" games in Conway's terminology; 
we will not deal with games where certain infinite plays are set to be draws and others 
to be winning for one of the two players, namely "mixed" games, or with "fixed" games, 
where infinite plays are all winning for one of the two players, see e.g. JBCG82J for more 
details. Since we take non terminating plays to be draws, the notion of winning strategy on 
hypergames has to be replaced by that of non-losing strategy. 

Combinatorial Game Theory started at the beginning of 1900 with the study of the 
famous impartial game Nim, which became also a movie star in the 60s, in the film "L'annee 
derniere a Marienbad" by Alain Resnais and Alain Robbe-Grillet. In the 1930s, Sprague 
and Grundy generalized the results on Nim to all impartial terminating [i.e. well-founded) 
games, |Gru39t [Spra35| . In the 1960s, Berlekamp, Conway, Guy introduced the theory of 
partizan games, which first appeared in the book "On Numbers and Games" |Con76j . In 
|Con76| , the theory of games is connected to the theory of surreal numbers. 

In |Con76| . the author focussed essentially on terminating games, i.e. games on which 
all plays are finite. Non-terminating games were intentionally neglected as ill-formed or 
trivial games, not interesting for "busy men", and their discussion was confined to a sin- 
gle chapter, inspired by |Smi66j . Non-wellfounded games have been later considered in 
[BCG82J . Chapters 11-12, were free, fixed and mixed games have been discussed. In these 
chapters, the authors also consider an interesting generalization of the Grundy-Sprague 
theory, originally due to Smith [ Smi66| , which provides natural notions of canonical forms. 
However, not much attention has yet been paid to generalize the results in |Con76) to 
non-terminating free games. 

Possibly non-terminating games, which we call hypergames, can be naturally defined 
as a final coalgebra of non-wellfounded sets {hypersets), which are the sets of a universe 
of Zermelo-Fraenkel satisfying a suitable Antifoundation Axiom, see |FH831 IAcz88| . This 
definition generalizes directly the original one in |Con76| . where games are taken to be well- 
founded sets. Once hypergames are defined as a final coalgebra, operations on Conway's 
games, such as disjunctive sum, can be naturally extended to hypergames, by defining them 
as final morphisms into the coalgebra of hypergames. 

Our approach is different from other approaches in the literature, where games are 
defined as graphs or pointed graphs. Viewing games as sets (or points of a final coalgebra) 
allows us to abstract away from superficial features of positions and to reason directly up-to 



F. HONSELL AND M. LENISA 



graph bisimilarity. Our approach is justified by the fact that all important properties of 
games in Conway's setting, e.g. existence of winning/non-losing strategies, are invariant 
under bisimilarity. 

Our theory of hypergames generalizes the original theory on Conway's games of |Con76] 
rather smoothly, but significantly. Two important results in our paper are Determinacy and 
a Characterization Theorem of non-losing strategies on hypergames. The latter requires (a 
non-trivial) generalization of Conway's partial order relation on games to hypergames. 

On top of bisimilarity, various notions of equivalences and congruences on games and 
hypergames, arising by looking at strategies, are studied in this paper. In particular, we 
investigate various characterizations of the greatest congruence w.r.t. sum, refining the 
equideterminacy relation. One interesting result of our investigation is that this congruence 
coincides on Conway's games with the equivalence induced by Conway's partial order, and 
with the (extended) Grundy semantics on impartial (hyper)games. 

For the class of impartial hypergames, we revisit and extend in a coalgebraic setting 
the theory of Grundy-Sprague and Smith based on the canonical Nim games, by introduc- 
ing suitable canonical oo -hypergames. We show that such canonical hypergames can be 
construed in our setting as a truly compositional semantics of impartial hypergames, fully 
abstract w.r.t. the greatest behavioral congruence. Such semantics is given via a suitable 
generalized Grundy function, which we define on the whole class of hypergames. Our ap- 
proach extends other approaches in the literature, where the generalized Grundy function 
is defined only on certain classes of finite cyclic graphs, see e.g. [FROlj . 

This paper is a revised and extended version of [ HL09J . The parts on game and hyper- 
game equivalences, and semantics are new. The section on impartial hypergames has been 
substantially revised and extended. 

Summary. In Section [21 we provide a presentation of Conway's games as an initial alge- 
bra, and we introduce hypergames as a final coalgebra for the same functor. We discuss 
determinacy of games, and we prove characterization theorems for winning and non-losing 
strategies. In Section [3l we give coalgebraic definitions of sum and negation on hypergames, 
which extend original Conway's definitions. In Section U we study equivalences on games, 
in particular we introduce and study the notion of contextual equivalence. In Section \5\ 
we investigate impartial hypergames. In particular, we extend the Grundy-Sprague theory, 
and we define a generalized Grundy function, which gives a compositional semantics for 
hypergames, fully abstract w.r.t. contextual equivalence. Comparison with related games 
and directions for future work appear in Section [H 

Acknowledgements. We would like to thank the anonymous referees for many useful com- 
ments, which helped in improving the paper. 

2. From Conway's Games to Hypergames 

In this section, first we present Conway's games as an initial algebra for a suitable functor, 
then we introduce hypergames as a final coalgebra for the same functor. We take infinite 
plays to be draws, and hence Conway's notion of winning strategy has to be generalized 
by that of non-losing strategy. In this section, we present fundamental results on hyper- 
games, generalizing corresponding results on Conway's games. In particular, we discuss 
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determinacy of games, i.e. existence of winning/non-losing strategies, and we prove char- 
acterization theorems for winning and non-losing strategies, which extend in a non-trivial 
way corresponding results on Conway's games. 

We recall that Conway games are 2-player games, the two players are called Left (L) 
and Right (R). Such games have positions, and in any position x there are rules which 
restrict Left to move to any of certain positions, called the Left positions of x, while Right 
may similarly move only to certain positions, called the Right positions of x. Since we 
are interested only in the abstract structure of games, we can regard any position x as 
being completely determined by its Left and Right options, and we shall use the notation 
X = {X^,X^), where X^,X^ denote sets of positions. Games are identified with their 
initial positions, and they can be represented as the tree of all positions generating from the 
initial one. Left and Right move in turn, and the game ends when one of the two players 
does not have any option. All games are terminating, i.e. infinite sequences of moves cannot 
arise. However, there can be possibly infinite moves at any position. 

Remark 2.1. Contrary to other notions of games, where only player I (the player who 
starts the game) and player II are considered, Conway distinguishes also between L an R. 
Both the case where L starts the game, i.e. he acts as player I, while R acts as player 
II, and the case where L acts as player II and R as player I are considered. This extra 
complexity allows for a definition of the sum operation on games, which is central to the 
theory of Conway games, and which is such that the alternance of player I and player II can 
break in any single component. Thus the need of considering, at each step, all the possible 
moves of both L and R on the games where L and R have different sets of moves. 

Conway's games can be viewed as an initial algebra of a suitable functor. Although 
such games are well-founded, in view of extensions to non-wellfounded games, we work in 
the category Class* of classes of possibly non-wellfounded sets (hypersets) and functional 
classes o 

Definition 2.2 (Conway Games). The set of Conway's Games Q is inductively defined by 

• the empty game (0, 0) G Q; 

• if X, X' C Q, then {X, X') G Q. 

Equivalently, Q is the carrier of the initial algebra {Q, id) of the functor F : Class* -^ Class*, 
defined by F{A) = 'P{A) x V{A), where 'P(A) is the powerset functor (with usual definition 
on morphisms). 

Notation. Games will be denoted by small letters, e.g. x, with x = {X ,X ), and x ,x 
will denote generic elements of X^, X^. We denote by PoSx the set of positions hereditarily 
reachable from x. 

Some simple games. The simplest game is the empty one, i.e. (0, 0), which will be denoted 
by 0. Then we define the games 1 = ({O},0), -1 = (0,{O}), *1 = ({0},{0}). Intuitively, 
in the game 0, the player who starts will lose (independently whether he plays L or R), 



Non-wcUfounded sets are the sets of a universe of Zermelo-Fraenkel satisfying the Antifoundation Axiom, 
see [FH83, Acz88;. Alternatively to classes of sets, we could consider an inaccessible cardinal n, and the 
category whose objects are the sets with hereditary cardinal less than k, and whose morphisms are the 
functions with hereditarily cardinal less than k. We recall that the hereditary cardinal of a set is the 
cardinality of its transitive closure, namely the cardinality of the downward membership tree which has the 
given set at the root. 
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since there are no moves. Thus player II has a winning strategy. In the game 1 there is a 
winning strategy for L, since, if L plays first, then L has a move to 0, and R has no further 
move; otherwise, if R plays first, then he loses, since he has no moves. Symmetrically, —1 
has a winning strategy for R. Finally, the game *1 has a winning strategy for player I, since 
he has a move to 0, which is losing for the next player. Intuitively, a strategy for a given 
player is a function which, for any position where the player is next to move, gives, if any, 
a move for this player. A strategy is winning if it provides answers against any strategy 
for the opponent player. The notions of strategy and winning strategy are formalized in 
Section 12.11 below. 

Hypergames can be naturally defined as a final coalgebra on possibly non-wellfounded 
sets: 

Definition 2.3 (Hypergames). The set of hypergames T-i is the carrier of the final coalgebra 
{7i, id) of the functor F : Class* -^ Class*. 

Hence hypergames subsume Conway's games. In the sequel, we will often refer to 
hypergames simply as games. 

Defining hypergames as a final coalgebra, we immediately get a Coinduction Principle 
for reasoning on possibly non-wellfounded games: 

Lemma 2.4. A i^-bisimulation on the coalgebra {7i, id) is a symmetric relation TZ on 
hypergames such that, for any x = {X^,X^), y = {Y^,Y^), 

xUy =^ (Vx^ G X^.3y^ £ Y^.x^TZy^) A (Vx^ G X^3y^ £ Y^.x^TZy^) . 

Coinduction Principle 2.5. Let us call a F -hisimulation on (Ti, id) a hyperbisimulation. 
The following principle holds: 

TZ hyperbisimulation xTZy 
x = y 

Most notions and constructions on games taken as graphs are invariant w.r.t. hyper- 
bisimilarity. In particular, hyperbisimilar games will be equidetermined, i.e. they will have 
winning/non-losing strategies for the same players. Hypergames correspond to graphs taken 
up-to bisimilarity; the coalgebraic representation naturally induces a minimal representa- 
tive for each bisimilarity equivalence class. For instance, all game graphs with no-leaves are 
represented by the hypergame x = {x}. 

Some simple hypergames. Let us consider the following pair of simple hypergames: a = 
({6}, 0) and b = (0, {a}). If L plays as II on a, then he immediately wins since R has no 
move. If L plays as I, then he moves to 6, then R moves to a and so on, an infinite play is 
generated. This is a draw. Hence L has a non-losing strategy on a. Simmetrically, b has a 
non-losing strategy for R. Now let us consider the hypergame c = ({c}, {c}). On this game, 
any player (L,R,I,II) has a non-losing strategy; namely there is only the non-terminating 
play consisting of infinite c's. 

2.1. Strategies. Before giving the formal definition of strategy, we introduce the notion 
of play over a game as an alternating sequence of positions on the game, starting from the 
initial position, and we define winning and non-losing plays: 
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Definition 2.6 (Plays), 
(i) A play on a game x is a (possibly empty) finite or infinite sequence of positions vr 

x-|^ ^Xg ^ . . . such that 

• Vi Ki G {L,R}; 

• X = xo and Vi > (xf " = (Xf, Xf ) A xf^+^ G xf'), where ;^i = 

We denote by Play^ the set plays on x, by FPlay^ the set of finite plays on x, and by e the 
empty play. 

(ii) A play vr is winning for player L (R) iff it is finite and it ends with a position y = 
{Y^,Y^) where R (L) is next to move but Y^ = ^ (Y^ = 0). We denote by WPlay^ 
( WPlay^) the set of plays on x winning for L (R) . 

(iii) A play tt is a draw iff it is infinite. We denote by DPlay^ the set of draw plays, 
(iv) A play vr is non-losing for player L (R) iff it is winning for L (R) or it is a draw, i.e. 
we define NPlay^ = WPlay^ U DPlay^ {NPlay^ = WPlay^ U DPlayJ). 

Strategies for a given player can be formalized as functions on plays ending with a move 
of the opponent player, telling, if any, which is the next move of the given player. In what 
follows, we denote by 

• FPlay^ the set of finite plays on which L acts as player I, and ending with a position where 
L is next to move, i.e. FPlay^^ = {e}U{xf ^ . . . x^" G FPlay^, \ Ki = L A Kn = R, n > 1} 

• FPlay^ the set of finite plays on which L acts as player II, and ending with a position 
where L is next to move, i.e. FPlay^^^ = {x^^ ...x^" G FPlay^ \ Ki = R A K„ = 
R, n> 1}. 

• Similarly we define FPlay^^ , FPlay^^^ . 

We define: 

Definition 2.7 (Strategies). Let x be a game. 

(i) A strategy / for LI {i.e. L acting as player I) is a partial function / : FPlay^ -^ Posx 

such that, for any vr G FPlay^ , 

• /(tt) = x' =^ TTx' G FPlay^ 

• 3x'. TTx' G FPlay^ =^ tt G dom,{f). 

Similarly, one can define strategies for players LII, RI, RII. 
(ii) Moreover, we define: 

• a strategy for player L is a pair of strategies for LI and LII, f^j 1+) fill', 

• a strategy for player R is a pair of strategies for RI and RII, /rj I±) /rii', 

• a strategy for player I is a pair of strategies for LI and RI, /li tt) /r/; 

• a strategy for player II is a pair of strategies for LII and RII, fuj tt) /rh- 

Strategies, as defined above, provide answers (if any) of the given player on all plays end- 
ing with a position where the player is next to move. Actually, we are interested only in the 
behavior of a strategy on those plays which arise when it interacts with (counter) strategies 
for the opponent player. Formally, we define: 

Definition 2.8 (Product of Strategies). Let x be a game, and P a player in {LI, LII, RI, RII}. 

(i) Let vr be a play on x, and / a strategy on x for P. We say that vr is coherent with f if, 
for any proper prefix vr' of vr ending with a position where player P is next to move, 

/(vr') = x' =^ tt'x' is a prefix of tt . 
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(ii) Given a strategy / for P on x, and a counterstrategy /', i.e. a strategy for the opponent 
player, we define the product of / and /', / * /', as the unique play coherent with both / 
and /'. 

Now we are ready to define non-losing / winning strategies. Intuitively, a strategy is non- 
losing/winning for a player, if it generates non-losing/winning plays against any possible 
counterstrategy. 

Definition 2.9 (Non-losing/winning Strategies). Let x be a game, and P a player in {LI,LII, 
RI,RII}. 

(i) A strategy / on x is non-losing for P if, for any strategy /' on x for the opponent player, 
/ * /' G NPlay^. 

(ii) A strategy / on a; is winning for P if, for any strategy /' on x for the opponent player, 
/ * /' G WPlayP. 

(iii) A strategy /li W /lii for player L is non-losing/winning if f^j and fin are non- 
losing/winning strategies for LI and LII, respectively. Similarly for players R,I,II. 

Notice that on Conway's games, where infinite plays do not arise, the notion of non- 
losing strategy coincides with that of winning strategy. 

Intuitively, the winning condition on finite plays, "no more moves for the next player 
in the current position", does not depend on the "history", i.e. on the whole sequence of 
positions, but only on the the last position. Hence, having taken all infinite plays to be 
draws, one can prove that, for any non-losing/winning strategy on a game x, there exists a 
positional (history-free) non-losing/winning strategy on x. Formally, we define: 

Definition 2.10 (Positional Strategies). Let P be a player in {LI,LII,RI,RII}. 

(i) A positional strategy f for P on a: is a strategy for P such that, for all ttx', tt'x' G FPlay^ , 
either / is not defined on both ttx' and tt'x' , or /(vrx') = /{tt'x'). 

(ii) A positional non-losing/winning strategy for P is a positional strategy which is non- 
losing/winning for P. 

Proposition 2.11. Let P be a player in {LI,LII,RI,RII} . If there exists a non-losing /winning 
strategy f for P on x, then there exists a positional non-losing /winning strategy for P on x. 

Proof. Let / : FPlay^ — )■ Pos^; be a strategy for P on x. Then we can define a positional 
strategy / for P as follows. 

(i) 7(e) = f{e). 

(ii) For any Xj such that there exists vr. vrxj G doni{f), by the Axiom of Choice, we can choose 

an element Xj in 11^;- = {/(vrxj) | vr G FPlay^ A vrxj G dom{f) A vrxj coherent with /}, if 

n^i / 0, otherwise we choose Xj in {/(ttxj) | tt G FPlay^ A vrxj G dom{f)}. 

Clearly / is positional. Moreover, / is non-losing/winning iff / is. □ 

As a consequence of the above proposition, we can restrict ourselves to considering only 
positional strategies. 

2.2. Determinacy Results. On Conway's games a strong determinacy result holds, i.e. 
any game has a winning strategy for exactly one player in {L,R,I,II}. This does not hold on 
hypergames, where we can have non-losing strategies for various players at the same time, 
as in the case of the game c above. However, on any hypergame there exists a non-losing 
strategy for at least one player. Moreover, if there is a winning strategy for a given player. 
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then there are no non-losing strategies for the other players. This subsumes Conway's 
determinacy result. In what follows, we formalize the above results. 
The following lemma is instrumental: 

Lemma 2.12. Let x be a game. 

(i) LI has a winning strategy on x iff RII does not have a non-losing strategy on x. 

(ii) LII has a winning strategy on x iff RI does not have a non-losing strategy on x. 
(iii) Symmetrically, exchanging the role of L and R. 

Proof. 

(i) (=^) Let / be a winning strategy for LI. Then, by definition, for any strategy /' for RII, 
/ * /' is winning for L. Hence RII cannot have any non-losing strategy, 
(i) (<^) Assume RII has no non-losing strategy. Then we can build a strategy / : FPlay^ — )■ 
Posx for LI by induction on finite plays, with the property that, for any play tt G FPlay^ 
coherent with /, /(tt) is defined and RI has no non-losing strategy from 7r/(7r). Namely, 
since RII has no non-losing strategy on x, then there exists an opening L move such that 
RI has no non-losing strategy from that position. This allows us to define / on the empty 
play. Now assume to have defined / on plays of length n. Let us consider a play vr of length 
n-|-l coherent with /. By induction hypothesis, RI has no non-losing strategy from vr, hence 
for any R move from vr to a position x' , L has an answer bringing to a position where RI 
has no non-losing strategy. This allows us to extend / on all plays of length n + 2 coherent 
with /; on plays of length n-\- 2 not coherent with / but extensible with a L move, we can 
define / in an arbitrary way. This gives a strategy for LI, which is winning, because, by 
definition of /, for any counterstrategy /' for RII, f * f cannot be non-losing for R. 
(ii)-(iii) The proofs are similar to the above one. □ 

Theorem 2.13 (Determinacy). Any game has a non-losing strategy at least for one of the 
players L,R,I,IL 

Proof. Assume by contradiction that x has no non-losing strategies for L,R,I,II. Then in 
particular x has no non-losing strategy for LI or for LII. Assume the first case holds (the 
latter can be dealt with similarly). Then, by Lemma 12.121 x has a winning strategy for 
RII. Now, since by hypothesis R has no non-losing strategy, then there is no non-losing 
strategy for RI. But then, by Lemma 12.121 there is a winning strategy for LII. Therefore, 
by definition, there is a winning strategy for II. Contradiction. □ 

Theorem 12.131 above can be sharpened, by considering when the non-losing strategy is 
in particular a winning strategy: 

Theorem 2.14. Let x be a game. Then either there exists a winning strategy on x for 
exactly one of the players L,R,I,II, and there are no non-losing strategies for the other 
players; or at least two of L,R,I,II have a non-losing strategy. In this latter case either (i) 
or (ii) holds: 

(i) either L or R have a non-losing strategy and either / or II have a non-losing strategy; 
(ii) all players L,R,I,II have a non-losing strategy. 

Proof. Assume e.g. L has a winning strategy on x. Hence, by Lemma I2.12|, both RI and 
RII have no non-losing strategies. Therefore, R,I,II do not have non-losing strategies. 
Otherwise, assume e.g. L has a non-losing strategy but no winning strategies on x. Then 
three cases can arise: (1) both LI and LII have no winning strategies; (2) LI has no winning 
strategy, but LII has a winning strategy; (3) LI has a winning strategy, but LII has no 
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Figure 1: The space of hypergames. 



winning strategy. In the first case, by Lemma 12.121 both RII and RI have a non-losing 
strategy. Hence all players, L,R,I,II, have non-losing strategies. In the second case, by 
Lemma 12.121 RII has a non-losing strategy, but RI has no non- losing strategy, hence player 
II has a non-losing strategy, while both R and I have no non-losing strategies. Using a 
similar argument, one can show that in the third case, I has a non- losing strategy, but both 
R and II have no non- losing strategies. □ 



According to Theorem 12.141 above, the space of hypergames can be decomposed as in 
Figured) For example, the game c = ({c}, {c}) belongs to the center of the space, because 
it has non-losing strategies for all players, while the games a = {{b}, {}) and b = ({}, {a}) 
belong to the sectors marked with L,II and R,II, respectively, and the games gq = {{bo}, {0}) 
and 6o = ({0}, {oq}) belong to the sectors marked with R,I and L,I. 

As a corollary of Theorem 12.141 above we get Conway's determinacy result: 

Theorem 2.15 (Determinacy, |Con76j ). Any Conway's game has a winning strategy either 
for L or for R or for I or for II. 

As a consequence, Conway's games are all in the sectors L,R,I,II of Figure [TJ However, 
notice that these sectors do not contain only well-founded games, e.g. the non-wellfounded 
game d = {{d!}, {d'}), where d' = ({fi',0}, {d',0}) has a winning strategy for II. 



2.3. Characterization Results. In |Con76| . a relation > on games is introduced, inducing 
a partial order (which is a total order on the subclass of games corresponding to surreal 
numbers). Such relation allows to characterize Conway's games with a winning strategy for 
L,R,I or II. In what follows, first we recall the above results on Conway's games, then we 
show how to generalize them to hypergames. This generalization is based on a non-trivial 
extension of the relation >. 

The definition of > might appear a little strange at first. However, its structure is 
ultimately easy to grasp if we restrict to so called surreal numbers, i.e. games where all 
L members are hereditarily non-> of any R member. The definition then is akin to the 
definition of Dedekind section on real numbers. The only difference lying in the fact that 
surreal numbers are defined inductively, rather than "impredicatively" , as in the case of 
real numbers. 
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Definition 2.16 ([Con76|). Let x = {X^,X^), y = {Y^,Y^) be Conway's games. We 
define, by induction on games: 

x>y iff Vx^ G X^. {y 1 x«) A Vy^ G F^. (y^ ^ x) . 

Purtliermore, we define: 

- x> y iff x>y A y^x 

- X r^y iff x>y A y>x 

- x\\y {x fuzzy y) iffx^yAy^x 

Notice that ^ does not coincide witli <, e.g. *1 = ({0}, {0}) is such that *1 ^ holds, 
but *1 ^ does not hold. As one may expect, 1 > > — 1, while for the game *1 (which is 
not a number), we have *1||0. Moreover: 

Proposition 2.17 ([ ConTGj ). ~ is an equivalence relation. 

However, notice that || is not an equivalence relation, since || is not reflexive: trivially 
it is not the case that 0||0. 

The following important theorem gives the connection between Conway's games and 
numbers, and it allows to characterize games according to winning strategies: 

Theorem 2.18 (Characterization, [Con76j ). Let x he a Conway's game. Then 
X > (x is positive) iff x has a winning strategy for L. 
X < (x is negative) iff x has a winning strategy for R. 
X -^ (x is zero) iff x has a winning strategy for II. 

x||0 (x is fuzzy) iff x has a winning strategy for I. 

The generalization to hypergames of Theorem 12.181 above is quite subtle, because it 
requires to extend the relation > to hypergames, and this needs particular care. We would 
like to define such relation hy coinduction, as the greatest fixpoint of a monotone operator 
on relations, however the operator which is naturally induced by the definition of > on 
Conway's games is not monotone. This problem can be overcome as follows. 

Observe that the relation > in Definition 12.161 is defined in terms of the relation ^. 
Vice versa ^ is defined in terms of > by: 

X ^ y iff Bx^.y > x^ V 3/./ > x . 

Therefore, on hypergames the idea is to define both relations at the same time, namely 
through the greatest fixpoint of the following operator on pairs of relations: 

Definition 2.19. Let $ : VCH xn)x V{n xU) — > V{n xn)x V{n x U) be the operator 
defined by: 

^{ni,n2) = {{{x,y) \yx^.yTZ2X^ A yy^.y^TZ2x}, 

{(x,y) I Bx^.ylZix^ V By^.y^Ilix}) 

The above operator is monotone componentwise. Thus we can define: 

Definition 2.20. Let the pair ( ^, ► ) be the greatest fixpoint of <1>. 
Furthermore, we define: 

- x\>y iff x>y A y^x 

- x\xiy iff x>y A y^x 

- x\\y iff x^y A y^x 
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As an immediate consequence of Tarski's Theorem, the above definition of the pair of 
relations ( >, ►) as the greatest fixpoint of ^ gives us Coinduction Principles, which will 
be useful in the sequel: 

Coinduction Principle 2.21. We call <l>-bisimulation a pair of relations (7^1,7^2) such 
that (7^1,7^2) ^ ^{TZi,TZ2)- The following principles hold: 



(7^1,7^2) ^-bisimulation xTZ2y 



x\>0 


€ 


x<lO 


^ff 


xtxiO 


^ff 


x\\0 


^ff 


^roof. 


(^)A 



(7^1, 7^.2) ^ -hisimulation xTZiy 
X ^y 

Notice that the pair of relations (>, ^) on Conway's games coincides with the restriction 
of ( >, ► ) to Conway's games. Namely, the pair (>, ^) is the least fixpoint of $. 

Moreover, somewhat surprisingly at first sight, notice that the relations > and ► are 
not disjoint. E.g. the game c = ({c}, {c}) is such that both c>0 and c^O (and also 0>c 
and O^c) hold. However, this is perfectly consistent in the hypergame scenario, since it is 
in accordance with the fact that some hypergames have non-losing strategies for more than 
one player. The following generalizes Conway's Characterization Theorem 12.181 

Theorem 2.22 (Characterization). Let x be a hypergame. Then 

X has a non-losing strategy for L. 

X has a non-losing strategy for R. 

X has a non-losing strategy for II. 

X has a non-losing strategy for I. 

Assume x [>0, i.e. x>0 and O^x. We have to build non-losing strategies fu 
for LI and fLii for LIT. For LIT: since x >0, then, by definition, \/x .O^x , i.e., for any R 
move x^, O^x^. Let x^ = {X^^,X^^), then 3x^^ G X^^.x^^ >0, that is there exists a 
L move x^^ such that x^'^ >0. Hence, for any x^ G X^, we define fiiii^^) = x^^. Then, 
in order to extend the definition of fiii, we can apply again the two steps above starting 
from X^^: either we go on forever or we stop when R cannot move. In this way, we define 
Fljj on coherent plays; on other plays fLjj can be defined in an arbitrary way. For LI: 
since O^x, then 3x^.x^ >0. This allows us to define fii on the empty play. The definition 
of fii can then be extended from x^, using the above construction of a non- losing strategy 
for LII. 

The other cases are dealt with similarly. 

(<^) We proceed by coinduction, by showing all the four cases at the same time. Let 
TZi = {(x,0) I X has a non-losing strategy for LII} U 

{(0,x) I X has a non-losing strategy for RII}, 
^2 = {ix,0) \ X has a non-losing strategy for RI} U 

{(0,x) I X has a non-losing strategy for LL}. 
We prove that (7^1,7^2) is a ^-bisimulation. There are various cases to discuss. We only 
show one case, the others being similar. We prove that, if x7^iO and x has a non-losing 
strategy for LII, then \/x .0TZ2X ■ If LII has a non-losing strategy on x, then, for all x , 
there is a non-losing strategy for LI on x , hence, by definition, \/x .0TZ2X ■ Q 

The following table summarizes the Characterization Theorem: 



Non-losing strategies 


Relations w.r.t. 


L 


x\>0 


x>0 A O^x 


R 


x<\0 


x^O A 0>x 


II 


XDXlO 


x>0 A O^x 


I 


X 


x^O A O^x 
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2.3.1. Properties of >. The following proposition, which can be proved by coinduction, 
generahzes the corresponding results of |Con76] to hypergames: 

Proposition 2.23. For all hypergames x, y, we have 
(i) X \>y V X ►y . 
(ii) x^x A x ►j; A x^x A xtxx . 

Proof. 

(i) If x \>y then we are done. Otherwise, assume -ix \>y. Then we show that x>_y. Namely, 
let 

ni = {{x,y)\^x>iy} and 7^2 = {(x,^) | -.x >y} . 
One can easily check that (T^i, 7^2) is a $-bisimulation. Therefore, in particular -ix ^y =^ 
x^y. 
(ii) One can easily prove that the pair (7^1,7^2) is a <l>-bisimulation, where 

7^l = {(x,x) \xen} and 112 = {{x,x^) | x G ^} U {(x^,x) | x e 7^} . 

D 

As a consequence of Proposition 12. 23T i). Theorem 12.221 can be specialized as follows: 

Theorem 2.24. Let x he a hypergame. Then 
X ^0 iff X has a non-losing strategy for LII. 

x^O iff X has a non-losing strategy for RI. 

^x iff X has a non-losing strategy for RII. 

► X iff X has a non-losing strategy for LI. 

Proof. Assume x C>0. Then we show that x has a non-losing strategy for LII. Namely, by 
Proposition 12.231 1). >x or O^x. In the first case, x ^0 and 0>x, i.e. xcxiO and, by 
Theorem 12.221 x has a non-losing strategy for II. In the latter case, x >0 and O^x, i.e. 
X >0 and, by Theorem 12.221 x has a non-losing strategy for L. Vice versa, assume x has a 
non-losing strategy for LII. Then we show that x has a non-losing strategy for L or for II. 
Thus, by Theorem 12.221 x >0. Assume by contradiction that x has no non-losing strategies 
for L and II. Then x has no non-losing strategies for LI and RII, hence x has no non-losing 
strategies for L,R,I,II, contradicting Theorem 12. 13[ The other cases can be proven similarly. 

D 

Contrary to what happens on Conway's games, the relation > is not a partial order on 
hypergames, since > fails to be transitive; as a consequence, ixi is not an equivalence. 

Counterexample. Let c = ({c},{c}) and ci = ({ci},{0}). Then c>0, since c has non- 
losing strategies for all the players. Moreover, one can show that ci >c, by coinduction, by 
considering the relations TZi = {(ci,c)} U {(0, c)} and 7^2 = {(C) ci)} U {(c, 0)}. Thus we 
have ci \>c A c>0. However, one can easily check that ci >0 does not hold. 
The problem is that the "pivot" c allows for unlimited plays. Transitivity can be recovered 
on pairs where the pivot is a well-founded game. We omit the details. 
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3. Operations on Games: Sum and Negation. 

An important operation on games studied in |Con76] is sum, arising when more games 
are played simultaneously. There are various ways in which we can play several different 
games at once. We shall focus only on the most literal one, where at each step the next 
player selects any of the component games and makes any legal move on that game, the 
other games remaining unchanged. The other player can either choose to move in the same 
component or in a different one. This kind of compound game can be formalized through 
the (disjunctive) sum, |Con76| . which can be naturally extended to hypergames via the 
following coinductive definition, whereby the sum operation is obtained as final morphism: 

Definition 3.1 (Game Sum). The sum on games is given by the the final morphism 
+ : {Ti X T-L,a+) — > (?^,id), where the coalgebra morphism a+ : Ti x Ti — > F(T-L x Ti) is 
defined by 
a+ix, y) = {{{x^,y) \ x^ G X^} U {{x, y^) \ y^ G Y^}, 

{{x^,y) I x^ G X^} U {{x,y^) \ y^ G Y^}) . 

n xn^ — ^n 

a+ id 

w 

F{nxn)^^F{n) 

That is + is such that: 

x + y = {{x^ + y \ x^ e X^} U {x + y^ I y^ G Y^}, 

{x^ + y \ x^ e X^} U{x + y^ \ y^ e Y^}) . 

The above definition of game sum subsumes the definition of sum on Conway's games. 
Game sum resembles shuffling on processes. In fact it coincides with interleaving in the case 
of impartial games, i.e. games on which L and R have the same options at any position. 

A typical example of a sum game arises when the two players play on two different chess 
boards at once, each time choosing a board on which to move, and performing a move on 
that board. Notice that in this way the alternance of L and R in the single component games 
is missed. Clearly, this is not the way simultaneous chess exhibition games are played. It is 
the way many end-games can be analyzed in Go, for instance. For other examples of sum 
games see Section 15. 2( where generalized Nim and "Traffic Jam" games are discussed. 

Game sum satisfies usual properties of sum (commutativity, associativity, etc.) and it 
induces a commutative semigroup with the game as zero. These properties are established 
using the basic Coinduction Principle 12.51 Equality is hypergame identity. 

Proposition 3.2. For all games x,y,z, 
(i) X + = X 
(ii) X + y = y + X 
(iii) {x + y) + z = X + (y + z). 

Proof. By coinduction, showing that the symmetric closures of the relations TZi = {{x + 
0,x) I X G 7i}, 7^2 = {{x + y,y + x) \ x,y G V.}, 7^3 = {{{x + y) + z,x + {y + z)) \x,y,z eV.} 
are hyperbisimulations. □ 

The negation is a unary operation on games, which allows to build a new game, where 
the roles of L and R are exchanged. The following is the coinductive extension to hypergames 
of negation on Conway's games: 
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Definition 3.3 (Game Negation). The negation of a game is given by the final morphism 
— : (1-L,a-) — > (7^, id), where the coalgebra morphism a_ : H — > F{'H) is defined by 
a_(x) = {{x^ I x^ £ X^}, {x^ I x^ G X^}) . 

n — —^n 



F{n)-^F{n) 

That is: -x = ({-x^ | x^ € X^}, {-x^ \ x^ G X^}) . 

In particular, if x has a non-losing/winning strategy for LI (LII), then —x has a non- 
losing/ winning strategy for RI (RII), and symmetrically. Taking seriously players L and R 
and not fixing a priori L or R to play first, makes the definition of — very natural. 

The following basic properties of negation can be easily shown by building corresponding 
hyperbisimulations: 

Proposition 3.4. For all games x, y, 

(i) -{x + y) = -x+ {-y) 
(ii) — (— x) = X. 

In what follows, we use the notation x — y to denote x + (— y). 

In Proposition 13. 61 below, we summarize some properties of sum and negation w.r.t. the 
relation >, that subsume corresponding results on Conway's games. These properties will 
be useful in Section U where we will discuss equivalences and congruences on games. 

We start by introducing equideterminacy, a first natural equivalence on games induced 
by non- losing strategies. 

Definition 3.5 (Equideterminacy). Let x,y be games. We say that x and y are equideter- 
mined, denoted by x ]}; y, whenever x has a L (R,I,II) non-losing strategy if and only if y 
has a L (R,I,II) non-losing strategy. 

Notice that equideterminacy divides the space of hypergames in the equivalence classes 

of Fig. m 

Proposition 3.6. For all games x,y,z, 

(i) X — xixiO. 

(ii) x>0 A y>0 =^ x + y>0. 
(iii) X >y -^^ X — y >0. 
(iv) X >y =^ X + z \>y + z. 

(v) y ttO =^ x + y ]};x. 
(vi) y — 2^0 /\ z — z'^Q =^ X + y'^x + z. 

Proof. 

(i) By the Characterization Theorem 12.221 it is sufficient to prove that x — x has a non- 
losing strategy for II. This is the copy-cat strategy, according to which, at each step, player 
II simply "copies", in the other component of x — x, each move of player I in a component 
of X — X. We omit the straightforward formalization of the copy-cat strategy, 
(ii) By Theorem 12. 24^ it is sufficient to prove that LII has a non-losing strategy on x + y, 
assuming that LII has non-losing strategies on x and y. A non- losing strategy for LII on 
x + y can be obtained from the strategies on x and y, since L can always reply in the 
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component where R moves in, by making a move according to the non-losing strategy in 
that component. 

(iii) By Theorem 12.241 it is sufficient to prove that x >y iff x — y has a non-losing strat- 
egy for LII. The implication => follows by building directly a strategy for LII, using the 
definition of >. For the converse implication, assume x — y ^0. Then, by Theorem 12.241 
X — y has a non-losing strategy for LII. The thesis can then be proved by coinduction, 
showing that the following pair of relations is a <l>-bisimulation: TZi = {(x,y) | x — 
y has a non-losing strategy for LII }, IZ2 = {(x,y) | x—y has a non-losing strategy for LI }. 
(iv) Assume x >y. Then, by item (iii) of this proposition, x — y >0. By item (i), z — z ^0. 
Therefore, by item (ii), x — y + {z — z) >0, i.e. x + z — [y + z) >0, hence, by item (iii), 
X + z \>y + z. 

(v) From y ;]]; 0, by definition of \^ it follows that y has a winning strategy for II. We have 
to prove that x^y\x. Assume x has a non-losing strategy for e.g. L. Then one can easily 
show that L has a non-losing strategy on x -|- y as well, whereby L moves in x according to 
the above non-losing strategy, and responds in y to any move of R following the winning 
strategy for II which exists on y by hypothesis. Vice versa assume by contradiction that L 
has a non-losing strategy on x -|- y but no non- losing strategy on x. Then, by Lemma 12.121 
RI or RII has a winning strategy on x. But then RI or RII has a winning strategy on 
x -|- y as well, whereby R moves on x according to the winning strategy and plays as II 
on y according to the winning strategy which exists by hypothesis. By Lemma 12.121 this 
contradicts the fact that L has a non- losing strategy on x -|- y. 

(vi) Assume y — z\^ and z — z\^. Then, by item (v), since y — z\Q^x^z^{y — z)\x^z. 
Now x^z^{y — z) = x^y + {z — z) and, since z — z ^ 0, by item (v), x^y^{z — z) \.x^y. 
Hence, by transitivity oi\^ x ^y\x ^ z. D 

Remark 3.7. 



(i) Notice that, on Conway's games, x ]}; is equivalent to x ~ 0, since, by Theorem 12.181 
X ~ is equivalent to having a winning strategy for player II on x. 

However, the implication xixiO =^ x ^ does not hold on hypergames, since e.g. ctoO, 
where c = ({c},{c}), because c has a non-losing strategy for II, while c ^ 0, since c has 
non-losing strategies for all players. 

(ii) By (i), for Conway's games, items (v) and (vi) of Proposition [3^ can be rephrased as 

a. y ~ =^ X -|- y ~ X 

b. y — z~0 A z — z r-^ =^ X + y ^ X + z. 

(iii) By Proposition 12.171 and item (iv) of Proposition 13. 6| using commutativity of -|-, it 
follows that the equivalence ~ on Conway's games is a congruence w.r.t. sum. 
(iv) Proposition 13.61 above gives an intuitive justification for why ~ is reflexive (and an 
equivalence relation on Conway's games), while || is not. Namely, by Proposition 13.61 items 
(iii) and (i), and by the Characterization Theorem 12.181 we have that x ~ x corresponds 
to having a winning strategy for player II on x — x. This is the very structural "copy-cat" 
strategy, whereby player II copies any move of player I in the other component. The copy- 
cat strategy on x — x is independent from the given game x. This is the reason why player 
II has a special role. There is no counterpart of such a structural general strategy for player 
I. The existence of a winning strategy for player I always depends on the specific nature of 

X. 
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4. Game Equivalences 

Having defined games as elements of a final coalgebra, we have already taken games up-to 
bisimilarity equivalence, thus abstracting from superficial features of positions. Bisimilarity 
is a first structural equivalence on position graphs, but on top of this one can define various 
notions of equivalences and congruences on games, by looking at strategies. 

A first notion of equivalence induced on games by strategies is equideterminacy ^. This 
is quite coarse, since it divides the space of hypergames in the equivalence classes of Fig. [TJ 
Trivially, ]}; is not a congruence w.r.t. sum, already on Conway's games, since e.g., for the 
games *1 = ({0},{0}), *2 = ({0, *1}, {0, *!}), we have: *1 $ *2, but *1 + *1 f *2 + *1, 
because *1 + *1 has a winning strategy for player II, while *2 + *1 has a winning strategy 
for player I. 

The equivalence ~ on Conway's games is a congruence (see Remark 13.7( 111)). however, 
its extension to to hypergames fails to be an equivalence. Therefore, a question which 
naturally arises is whether there exists an equivalence on hypergames which extends ~. 
The notion of contextual equivalence provides an answer to this question. This is defined 
as the closure under additive contexts of equideterminacy: 

Definition 4.1 (Contextual Equivalence), 
(i) Let us consider the following class of additive contexts on games: 

C[] ::= [] \C[]+x\x + C[], 

where x is a game. 

(ii) Let ~ be the contextual equivalence on games defined by: 

xf^y ^^ yC[].C[x]tC[y]. 

It is interesting to notice that, if x ~ y, then x i^ y. Moreover, if ~ is a congruence 
satisfying this property, then ~Cpa. I.e., we have: 

Lemma 4.2. The contextual equivalence ~ is the greatest congruence refining equidetermi- 
nacy. 

Proof. By definition, ~ refines equideterminacy, i.e. j;~y =^ x i^ y, and « is a congruence, 
i.e. X ~ y =^ VC[ ]. C[x] ~ C[y]. Now assume that ~ is a congruence which refines 
equideterminacy. If x ~ y, then VC[ ]. C[x] ~ C[y], since ~ is a congruence; moreover, 
since ~ refines equideterminacy, we have VC[ ]. C[x] :([; C[y], hence x ^ y. D 

As an immediate consequence of commutativity and associativity of sum (Proposi- 
tion [32]), we have that the class of contexts in the definition of ~ can be reduced as follows: 



Lemma 4.3. 

x^y ^^ yD[].D[x]tD[y] 
where D[ ] ranges over contexts of the shape [] + z, for z any game. 

Finally, we show that the contextual equivalence ^ coincides with ~ on Conway's games. 
Theorem 4.4. For all Conway's games x,y, 

X ^ y <^^ X ~ y . 
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Proof. (^) Let x k, y. Then x — y '^ y — y. Moreover, by Proposition I3.6( i). y — y ^ 0, 
hence y — y ^ 0, hy Remark l3.7r i). Therefore, by transitivity oi ^, x — y '^ 0. Hence, by 
Remark I3.7r i). x — y ^ 0. Finally, by Proposition 13. Gf iii). x ~ y. 

(<^) Let X ^ y. Then, by Proposition l3.6l fiii). x — y ~ and, by Proposition l3.6r i). y — y ~ 0. 
Hence, by Remark l3.7r i). a; — y ^ and y — y 1^^- Then, by Proposition I3.6( vi). for any 
hypergame z, z + x '^ z + y, thus x ^ y. D 

Clearly, the extension of the above theorem to hypergames fails, since ixi is not an 
equivalence. However, as we will see in the next section, when restricted to impartial 
hypergames, the contextual equivalence turns out to be the equivalence induced by the 
generalized Grundy semantics. 

5. The Theory of Impartial Games 

In this section, we focus on the subclass of impartial games, where, at each position, L and 
R have the same moves. Such games can be simply represented by x = X, where X is 
the set of moves (for L or R) . Coalgebraically, this amounts to saying that impartial games 
are the elements of the final coalgebra J' of the powerset functor. Thus they correspond 
directly to possibly non-wellfounded sets, and they can be represented as finite or infinite, 
possibly cyclic graphs, having a node for each position of the game, and a direct edge from 
X to y when it is legal to move from x to y. The subclass Z of impartial Conway's games 
correspond to well-founded sets and they form an initial algebra of the powerset functor. 

In this section, first we specialize some general results to the case of impartial hyper- 
games, including Determinacy and Characterization Theorems. Then, in Section 15. H we 
recall the Grundy-Sprague theory for dealing with impartial Conway's games, based on a 
class of canonical games. We show that these give, via the Grundy-Sprague function, a 
compositional semantics of games, that induces exactly the contextual equivalence ss. In 
Section [5.21 we extend the above theory to hypergames, by revisiting in a coalgebraic set- 
ting Smith's generalization of Grundy-Sprague results. In particular, we introduce a class of 
canonical hypergames, extending the Nim numbers. Moreover, we show how to extend the 
semantics given by the Grundy function for impartial Conway's games to the whole class 
of impartial hypergames. Our approach extends other approaches in the literature, where 
the generalized Grundy function is defined only on certain classes of finite cyclic graphs, 
see e.g. [FROlj . We illustrate our results on an example. 

Since on impartial games the distinction between L and R is blurred, we can only 
consider player I and player II, and Theorem 12.141 specializes as follows: 

Theorem 5.1. Any impartial game has a winning strategy either for player I or for player 
II or the two players can draw. 

Proof. The proof follows from Theorem 12.141 by observing that, on impartial games, L 
has a non-losing strategy iff R has, and neither L nor R can have a winning strategy, 
because otherwise we would have both L and R having a winning strategy, contradicting 
Theorem [2H D 
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Moreover, the following lemma holds: 

Lemma 5.2. Let x,y £ J'. Then 

[x>y <^^ y^x <;=> xtx\y) A (x^y <^=^ y^x -4=^ ^Wu) 

Proof. The proof is by coinduction, by showing that the following pair of relations is a 
$-bisimulation: T^i = {{y,x) \ x>y} and 7^2 = {iy,x) \ x^y}. In order to prove that 
(7^1,7^2) is a <l>-bisimulation, we assume (y, x) € TZi and we prove that Vx-^. {x^,y) G 
7^2 and Vy . {x,y ) € 7^2- We omit the proof for 7^2 which is similar. Assume then 
(y, x) € 7^1. Hence x >y, and by definition of ^, Vx'^. y ► x-^ and Vy^. y^ ► x. Hence, since 
X-^ = X^ and y^^ = Y^, we have Vx^. y ►x-^ and Vy^. y^ ►x. Thus, by definition of 7^.2, 
Vx-^. (x^,y) G 7^2 and Vy^. (x,y^) G 7^2. D 

Hence, by Theorem 12.241 and Lemma I5.1H we have: 

Theorem 5.3 (Characterization of Impartial Hypergames). Let x G J7. Then 
X >0 iff x has a non-losing strategy for IL 

X ► iff X has a non-losing strategy for L 

X >0 and not x ► iff x has a winning strategy for IL 

X ► and not x >0 iff x has a winning strategy for L 

5.1. Impartial Conway's Games. Impartial well-founded games are dealt with the the- 
ory of Grundy-Sprague, [Gru39l |Spra35| . Central to this theory is Nim, a well-known 
impartial game, which is played with a number of heaps of matchsticks. The legal move is 
to strictly decrease the number of matchsticks in any heap (and throw away the removed 
sticks). A player unable to move because no sticks remain is the loser. 

The Nim game with one heap of size n can be represented as the Conway game *n, 
defined (inductively) by 

*n = {*0, *!,..., *{n — 1)} , 
where *0 = 0. 

Namely, with a heap of size n, the options of the next player consist in moving to a heap 
of size 0, 1, . . . , n — 1. The number n is called the Grundy number of the game. Clearly, if 
n = 0, player II wins, otherwise player I has a winning strategy, moving to *0. 

Nim games can be naturally extended to heaps of arbitrary ordinal length, and they 
correspond precisely to von Neumann ordinals, i.e. *a = {*f3 \ (3 < a}. 

Notice that different Nim games are told apart by ~: 

Lemma 5.4. Let *q, */3 be Nim games. Then 

*a ~ */3 <^=^ a = /3 . 

Proof. If a 7^ /3, then *a 96 */3, since *a -\- *a has a winning strategy for II (the copy- 
cat strategy), while one can check that *a + */3 has a winning strategy for I. Hence, by 
Theorem 1331 *a 7^ */3. D 
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Nim games are central in game theory, since there is a classical result (by Grundy and 
Sprague, independently, jGru39l Spra35| ) showing that any impartial well-founded game 



"behaves" as a Nim game, in the sense that it is ~-equivalent to a single-heap Nim game 
(see [Con 76] . Chapter 11). The algorithm for discovering the Nim game (or the Grundy 
number) corresponding to a given impartial game x proceeds inductively as follows. 

Grundy Algorithm. Assume that the Grundy numbers of the positions in x are {qq, ai, . . .}, 
then the Grundy number of x is the minimal excludent (mex) of {ao,ai, . . .}, where the 
mex of a set X C Ord is the least ordinal in the complement set of X. 

Formally, the Grundy-Sprague function g : I ^ Ord, associating to each impartial 
Conway's game the corresponding Grundy number via the mex algorithm, amounts to the 
following algebra morphism: 

Proposition 5.5. Let mex : V{Ord) -^ Ord be the mex function. Then the Grundy- 
Sprague function g is the unique morphism from the initial V- algebra (Z, id) to the V -algebra 
{Ord, mex): 

^ 9 



Ord 



id 



V(I) ^V(Ord) 



The following holds: 



Theorem 5.6 f |Gru39[ [SpraSSJ ICon76p . 

i) Nim games are canonical, in the sense that, for any game x ^X, the Grundy function g 
gives the unique Nim game *g{x) such that x ~ *g{x). 

ii) Any impartial game x has a winning strategy for player II if and only if g{x) is 0, 
otherwise it has a winning strategy for player I. 



Sum of impartial games. In [Gru391 Spra35] , an efficient algorithm for computing the 



Grundy number corresponding to the sum of impartial games is provided, based on bi- 
nary sum without carries. Namely, for all numbers ni,n2, one can define the Nim sum of 
ni and n2 by ni © 71-2 = n, where n is the number resulting from the binary sum without 
carries of ni and 722. E.g. 1 © 3 = 2, since the binary sum without carries of 10 and 11 is 
10. 

The Nim sum satisfies the following property: 



Proposition 5.7 (fGruMl Spra35| ). For all Nim games *a, *(3, 

*a + */3 ~ *(a © /3) . 
As a consequence of the above proposition and of Lemma 15.41 we have: 
Corollary 5.8. For all x,y £ I, 

g{x + y) = g{x) ®g{y) ■ 

Proof. By Theorem I5.6( i). *g{x + y) ~ x + y, then by Theorem I5.6f i) and congruence of 
~, X + y ~ *g{x) + *g{y), hence by Proposition 15.71 and transitivity of ~, *g{x + y) ~ 
*{g{x) © g{y)). Finally, by Lemma[531 *9ix + y) = *{gix) © g{y)). D 
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By the above corollary, the Grundy number corresponding to x + y is obtained by Nim 
summing the Grundy numbers of x and y. The Nim sum is efficient when dealing with 
finite Grundy numbers. It applies also to infinite ordinals, but clearly for ordinals above 
limit ordinals, i.e. A such that 2^ = A, it does not provide substantial improvements w.r.t. 
the direct mex calculation of the sum game. 

Fully abstract semantics of impartial Conway's games. By Corollarv l5.8| the Grundy func- 
tion g provides a compositional semantics on impartial Conway's games. This semantics is 
fully abstract w.r.t. contextual equivalence, namely we have: 

Theorem 5.9 (Full Abstraction). For all x,y (zl, 

g{x) = g{y) ^^ x^y 

Proof. (=>) Let g{x) = g{y). By Theorem 15. 6( i). using transitivity of ~, we have x ~ y. 
Hence, by Theorem 14.41 x ~ y. 

(<^) Let X ~ y. By Theorem 14.41 and Theorem I5.6( i). using transitivity of ~, we have 
*g{x) K. *g{y). But then g{x) = g{y), by Lemma [531 D 

5.2. Impartial Hypergames. We introduce a class of canonical hypergames, extending 
the Nim games: 

Definition 5.10 (Canonical Hypergames). The canonical hypergames *a are defined by: 

• the Nim games *a, for a € Ord; 

• the hypergames *oo = {*oo} and *ook = {*cxd} U {*k \ k G K}, for K y^ ij), K Q Ord. 
The generalized Grundy numbers are the it's such that *a is a canonical hypergame. 

In what follows, we denote by a, r generalized Grundy numbers, and by a, (3 ordinal 
(well-founded) Grundy numbers. We will also use the notation *oo0 (oog) to denote the 
hypergame (Grundy number) *oo (oo). 

The following lemma holds on canonical hypergames: 

Lemma 5.11. The game *a is a win for player II if and only if a is 0, otherwise it is a 
win for player I. An hypergame *oo/^ is a win for player I if and only if £ K , otherwise 
both players have non-losing strategies. 

Proof. We only have to prove the thesis for the hypergames *ook, since for well-founded 
games *a the result follows from Theorem l5.61 Using Theorem l5.3t the thesis on hypergames 
follows by showing that: 

(a) any hypergame *ook is such that *ook ^ 0; 

(b) the hypergame *ook has no subscript iff *(X)k ^0. 

(a) First of all, notice that, since *cxd has a non-losing strategy for II, then, by Theorem [ 
and Lemma 15.21 *oo is such that > * oo. Then, by Definition of ► , we have *ooi^ ►O. 
(6 =^) Assume ^ K. Then *ook ^0, since, for all elements k £ K, O^k, hy Lemma [57 
and Proposition 12. 23T i). and O^: * cxo, because *oo has a non-losing strategy for I. 
(6 =^) Assume *ook ^0. If by contradiction £ K, then *ooi^ >0 does not hold, since 0^0 
does not hold. D 
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In the following lemma, we prove that different canonical hypergames are told apart by 
the contextual equivalence; this extends Lemma 15.41 to hypergames: 

Lemma 5.12. For all canonical hypergames *a,*T, 

*a ~ *T -4=^ a = T . 

Proof. Let a ^ t. Then we show that there is a context D[ ] such that D[*(t] ^ D[*t]. There 
are various cases to consider, according to the shape of *a, *r. If both a,T (£ Ord, then the 
thesis follows from Lemma 15.41 and Theorem 14.41 If cr = ooh, t = oo;^, H ^ K, then there 
exists a G H \ K (or a a K \ H). If a 7^ 0, then we get that *coh + *a has a winning 
strategy for player I, which opens on *oo/f moving to a, and then plays as II according to 
the copy-cat strategy. While one can easily check that *oox + *« has non-losing strategies 
for both players. If a = 0, then *a ^ *r, since, by Lemma I5.1H player II has a non-losing 
strategy on H (K) but not on K (H). If a G Ord and r = 00 i^:, then if cr = or i^, 
then, by Lemma 15.111 *a ^ *r. Finally, if cr = a, a 7^ 0, and r = 00 /^, G X, then 
for -D[ ] = [ ] + *a, we have that Z)[*cj] has a winning strategy for II, hence no non-losing 
strategies for I, while -D[*r] has a non- losing strategy for I. □ 

The Nim sum can be extended to the whole class of generalized Grundy numbers: 

Definition 5.13 (Generalized Nim Sum). The generalized Nim sum © is defined by ex- 
tending the Nim sum on 00-Grundy numbers by: 

a ® OOK = OOK © a = oojfcQa | k(^K} ook © ooh = 00 . 

The following extends Proposition 15.71 to the case of hypergames: 

Proposition 5.14. For all canonical hypergames *a,*T, 

*a + *T ^ *{a © r) . 

Proof. If (T, T G Ord, then the thesis follows by Proposition 15.71 and Theorem 14. 4[ Then 
assume that a = 00 k and r = a, or cr = 00 k and r = oo^- We have to show that 
Vz G J'. (*(T + *r) + 2: ]}; *((T © r) + 2. By Theorem 15.31 it is sufficient to prove that 

{*a + *T) + z>0 <;=^ *(o-©r) + z>0 and (*o- + *r) + z^:0 ^^ *(o- ©r) + z^O . (a) 

The two implications (=>) in (a) follow, using Lemma 15. 2^ by proving that the following 

pair of relations form a <&-bisimulation: 

^1 = {(*('7 © r) + z, 0) I z G J A {*a + *T)+z >0} 

^2 = {(0, *(cr © r) + z) [ z G J A ► {*a + *r) + z}. 

Namely, let {*{a © r) + z, 0) eTZi. We need to prove that Vx G *((T © r) + z. (0, x) G 7^2- 

Two cases arise: (i) x = *{a (B t) + z' and z' G z, or (ii) x = x' + z and x' G *(o" © r). 

In case (i), since {*a + *r) + z >0, then O^: {*a + *t) + z' , hence (0, *{a + r) + z') G 7^2- 

In case (ii), if cr = ook and t = a, then x' G *((T © r) iff (a) x' = *oo or (b) x' = *(/c © a), 

for k G K. If x' = *oo, we have to prove that (0, *oo + z) G 7^2- But, since 00 = oo©oo, it is 

sufficient to prove that 0^ *(oo©oo) + z. But this can be easily proved. If x' = *(A;©a), for 

k G K, then we have to prove that ► {*k + *a) + z. This follows from (*ook + *0i) + z >0, 

by definition of >, since */c G *ook- If <7 = ook and r = 00//, the proof is similar. 

Using similar arguments one can also prove that if (0, *((T ® t^ ^ z) G 7^,2, then 3x G 

*((J©t) + z. (0,x) G 7^l. 

Vice versa, in order to prove the implications (<^) in (a), it is sufficient to show that the 

following pair of relations form a <I>-bisimulation: 
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TZi = {((*o- + *t) + z,0)\ z £ J A *(o- e r) + z >0} 

'R-2 = {{0,{*a + *T)+z)\z£j A ► * (<T e r) + z}. 

We omit the proof which uses arguments similar to the ones above. □ 

Generalized Grundy function. We define a generalized Grundy function 7, associating to 
each hypergame x a generahzed Grundy number such that x ~ *7(x). As we wih show, as 
a consequence, such function provides a compositional semantics on hypergames, inducing 
the contextual equivalence «. 

We define the generalized Grundy function 7 : ^7 — )■ Ord U {ook \ K C Ord} in two 
steps. 

(1) First, we define 70 : J" ^ Ord U {_L} as least fixpoint of a suitable monotone operator. 
The function 70 will mark all positions ^-equivalent to a Nim game with the correspond- 
ing Grundy number, and it marks as _L all positions corresponding to 00-hypergames. 
More precisely, 70 : i7 ^ Ord U {_L} is defined as limit of subsequent approximations, 
starting from the overall undefined function /q = Aa;._L. Approximations of 70 are built 
by induction: at a given step, the next approximation function will mark a position x 
with the mex a of the successors of x which already have received a marking in Ord 
in previous steps, provided that any _L-successor y € x has a successor z £ y which is 
already marked by a. Intuitively, this marking procedure of a position x with a mex 
a will remain "correct" in the future, since any successor y € x, which has not yet 
received a marking in Ord, will never receive a as marking, because it has a successor 
already marked by a; thus a will remain the mex of the successors of x marked in Ord 
at any subsequent step. 

(2) Once we have defined 70, we can define the generalized Grundy function 7, by suitably 
marking _L-positions with cx)-Grundy numbers. 

In what follows, we formalize the construction hinted above. 

Definition 5.15. Let (Ord U {_L}, 1^) be the c.p.o. endowed with the fiat ordering such 
that J- Q a, for any a G Ord. 

i) Let ([.y — >■ Ord U {_L}], C) denote the space of functions f : J ^ Ord U {_L} endowed 
with the point-wise ordering on functions. 

ii) Let f £{J ^ Ord U {_L}] and let x G ^7, we define Tj{x) = {fy | y G x A /y 7^ _L}. 
iii) Let D ^\J ^ Ord U {_L}] denote the subspace of functions / such that, for all x G J", 

fx = a£ Ord =^ a = mex{Tf{x)) A Vy G x {fy = _L => 3z G y. fz = mex{Tf{x))) . 

Lemma 5.16. {D,Q) with the point-wise ordering on functions is a c.p.o. 

Definition 5.17. Let T : (D, Q) — > (D, Q) be the function operator defined by 

T(f)( ) = /'"^^(•^/(^)) if yyex{fy = ± =^ 3z e y. fz = mex{J='f{x))) 
I ± otherwise 

Lemma 5.18. The operator T is monotone over D. 

Proof. Let / !^ /'. Assume by contradiction that T{f) % T(f'). Then we necessarily have 
that T{f){x) = mex{Tf{x)) = a and T{f'){x) = mex{Ffi{x)) = a' with a 7^ a'. Since 
/ E /', this implies a < a' . Then there is y G x such that fy = a, while fy = _L. But 
then there is z G y such that fz = a. Thus, since / Q /', also f'z = a. This contradicts 
the fact that fy = a is a mex. □ 
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By Lemmata 15.161 and 15.181 we have: 
Theorem 5.19. The operator T has least fixpoint jq = \_\^^^^ fa, where 

fo= Xx.± /q+1 = Tfa /a = U ^-^^ ' ■^^'^ ^ ^^™^- 



Theorem 15. 191 above is an instance of a general fixpoint theorem. However, notice that, 
in this case, we have to pay attention to the fact that we are deahng with proper classes. 
There are various way outs. The most obvious rests on restricting on sets whose transitive 
closure has cardinality smaller than an inaccessible cardinal. Other approaches rely on the 
fact that the iterations are point-wise eventually constant. Namely, the value of the fixpoint 
on a given set is determined after a number of iterations corresponding to the cardinality 
of its transitive closure, which is always a set. 

By construction, 70 satisfies the following property: 



Proposition 5.20. For any x ^ J , 

70(2;) = a € Ord =^ a 



mex{7o(y) | y € x A 7(2/) € Ord} . 



Now we are ready to define the generalized Grundy function 7, which is obtained from 
7o by extending the marking on _L-positions. These will receive cxD-marking as follows: 



Definition 5.21 (Generalized Grundy Function). Let 7 : J^ 
defined by 



Ord U {00 A' I K e Ord} be 



7(x) 




if 7o (x) € Ord 

for K = {7(2/) \ y G X A 7o(y) 7^ -L}, otherwise 



Remark 5.22. Notice that any fixpoint of the operator T induces, via Definition 15. 2H 
a function which satisfies the axiomatization of generalized Grundy function given in the 
literature, see e.g. [FROlj . It has been shown that, for some classes of cyclic games, i.e. 
the locally path-bounded graphs, a generalized Grundy function exists uniquely with values 
m uj U {ooK}Keuij [FROlj . A graph is locally path-bounded if for every node x there is 
Ux & oj such that the length of every path consisting of different nodes, starting from x, 
does not exceed Ux- The above result of |FR01| can be strengthened, by observing that 
bisimilar graphs have the same Grundy function. Therefore, a Grundy function with values 
in OrdU {00 k}kguj exists uniquely on all graphs which are bisimilar to locally path-bounded 
graphs. However, notice that this is not the largest class of graphs for which a Grundy 
function with values in Ord U {ooK}Keui exists uniquely. Namely, there are path-finite but 
not locally-path bounded graphs for which such property holds, e.g. the following: 




1 




\i ^^^^ 




\ \ 1 




, \, 


1 ] 


L 1 



In this section, we have proved that a generalized Grundy function with values in 
Ord U {ooK}K£Ord exists on the whole class of hypergames. However, this is not unique, 
because T does not have a unique fixpoint. As a consequence, on hypergames, there exists 
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more functions satisfying the axiomatization of the Grundy function in |FR01| . Namely, let 
us consider the following infinite hypergame, on which the function 7 induced by the least 
fixpoint of T, 70, provides the marking: 



OOl 



OOl 



OOl 




One can check that there are other fixpoints of T, such as e.g. the function 7q, which on 
the hypergame above gives the following marking: 




Thus also 7q would satisfy the axiomatic definition of the Grundy function. However, if 
we denote by 7' the function induced by 7q via Definition 15. 21^ this provides a marking 
which is not safe, since it is not the case that x ~ *^'{x) for any x. Namely, some nodes 
marked with in the above figure have a non-losing strategy for player I. On the contrary, 
the least fixpoint 70 provides a safe marking, since, as we will prove, x ~ *7(x) for any x. 
Finally, it is interesting to notice that, if we add the natural requirement Vx. x ~ *^{x) 
in the axiomatization of the Grundy function, then, by Lemma l5.12^ the Grundy function 
exists uniquely on the whole class of hypergames. 



Properties of 'j. Here we show that 7 is "well-behaved", i.e., for any hypergame x, x ~ 
*7(x), and it provides a compositional semantics of hypergames, fully abstract w.r.t. the 
contextual equivalence ~. 



Theorem 5.23. For any x ^ J , we have 



*7(x) 



Proof. By Theorems 

x + z>0 



and l5.3|, it is sufficient to prove that, for any z ^ J, 

;=> *7(x) + z\>0 and x + z ► <;=> *7(x) + z ► . 

In order to prove (<^) implications, it is sufficient to show that the following pair of relations 

is a <I>-bisimulation: 

7^l = {(x + z, 0) I z E J^ A *7(x) + z >0} 712 = {{0,x + z) \ z £ J A ► * 7(x) + z}. 

Vice versa, in order to prove (=^) implications, it is sufficient to show that the following 

pair of relations is a <^-bisimulation: 

7^; = {(*7(x)+z,0) \zej A x + z\>0} n'2 = {(0,*7(x) + z) \ z e J A O^x + z}. 

Both proofs proceed by case analysis. We only show that if (x + z,0) G 7?-i, then Vy G 

X + z. (0,y) € 7^2- The other cases being dealt with similarly. If y € x + z is such that 
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Figure 2: A traffic jam game graph and the corresponding marked hypergame. 



y = x + z' and z' € z, the thesis follows from the fact that 0^ *^{x) + z' , since *'y{x) + z >0. 
li y = x' + z and x' € x, then if 7(x') € Ord, by definition of 7, *7(x') € *7(x), and hence 
► * 7(x') + z'^ thus (0, x' + z) E 7^2- If 7(2;') = co/^, then one can show that ► * ook + ^ 
using Theorem 15.31 since player I has always a non-losing strategy on *ook + z^ for any z. 
Hence (0, re' + z) G7^2. D 



By Theorem 15.231 and Proposition 15.14] we have: 
Proposition 5.24 (Compositionality). For all x,y ^ J, 

i{x + y) =i{x) ©7(y) • 

Theorem 5.25 (Full Abstraction). For all x,y ^ J, 

l{x) = l{y) ^^ x^y . 

Proof. (^) If 7(3;) = 7(7/), then *7(x) ^ *l{y)- Thus, using Theorem 15. 23^ we have 
x ^ *7(x) « *7(y) ~ y- 

(<^) If x ^ y, by Theorem 15.231 we have *'y{x) ^ x ^ y ^ *l{y)-, thus *7(x) R^ *^{y)- 
Hence, by Lemma 15.121 *7(x) = *7(y). Q 



A famous motivating example: Traffic Jams. For finite hypergames, the computation of the 
function 7 of Definition 15.211 is effective. Following [Con76] , consider the concrete game, 
corresponding to the game graph in the left-hand part of Fig. [2j Think of the graph as 
the map of a fictitious country, where nodes correspond to towns, and edges represent 
motorways between them. The initial position of the game corresponds to the town where 
a vehicle is initially placed. Each player has to move such vehicle to a next town along the 
motorway. If this is not possible, then the player loses. The hypergame corresponding to the 
game graph in the left-hand part of Fig. [2] appears in the righ-thand part, together with the 
marking given by 7. Positions C,D,K collapse to 0, positions A,E,G collapse to 1, positions 
B,F,H collapse to 2, position L corresponds to 3, positions N,0 collapse to 00, position 
I corresponds to oo{i2}, position J corresponds to oo|2}, and position M corresponds to 
00/2^3}. By Lemma l5.11l we can immediately check which player has a non-losing strategy 
in any original position. 

Now, let us consider a version of the above game with more than one vehicle, and where 
at each step the current player chooses a vehicle to move, assuming that each town is big 
enough to accommodate all vehicles at once. This game corresponds to the sum of the games 
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with single vehicles. In order to compute non-losing strategies for the sum game, one can 
use the generalized Nim sum, as defined in Definition l5.13[ If, for example, we have vehicles 
at positions H and I in Fig. [21 then the game is winning for player I, since H corresponds to 
2 in the hypergame and I to ooji 2}; ^^^ 2 ooji 2} = oo|2ei,2®2} = cxd|3 g}. While a game 
with vehicles in I and J is a draw, since J corresponds to oo|2} and oo|x^2} © ^^{2} = cx3. 
The game where infinitely many vehicles are parked in non-0 positions is a draw. 

Efficient characterizations of the contextual equivalence. Using the above results, one can 
check that, in the case of impartial hypergames, we can simplify the class of contexts in 
the definition of the contextual equivalence ~, by considering only well-founded canonical 
hypergames: 

Corollary 5.26. Let x,y £ J , then 

X ~ 2/ ^^=^ V*a well-founded canonical game, x + *a '^ y -\- *a . 

Proof. {=^) Immediate. 

(<^) By Theorem 15. 25 ( it is sufficient to show that, if 7(2;) 7^ 7(2/), then there exists a € Ord 
such that x+*a ^ y-\-*a. To this aim, by Theorem l5.23l and the fact that f« is a congruence, 
it is sufficient to show that *"f{x) + *a ^ *l{y) + *ol^ for some a E Ord. This can be easily 
shown by case analysis on 7(2;), 7(y), using the hypothesis 7(x) / 7(y). D 

The following definition allows us to identify "well-behaved" hypergames, and to for- 
mulate an alternative efficient characterization of the contextual equivalence on impartial 
hypergames: 

Definition 5.27. Let x be a hypergame. We define x JJ- iff x — x ]}; 0. 

Notice that the above definition is given for all hypergames. In the impartial case, x — x 
coincides with x -|- x, and being well-behaved amounts to having Grundy number in Ord. 
Conway's games are clearly well-behaved. The following characterization of ~ on impartial 
hypergames holds: 

Proposition 5.28. Let x,y £ J, then 

X sa y <;=► (xJJ. Ay-il Ax-Fy$0) V (xf Ayf A \/ * a. x -\- *a ^^ y -\- *a) . 

Proof. Since x JJ. iff 7(x) G Ord, it is easy to check that, if x ~ y, then either x J| A y JJ- 
or X ]jt^ A y i^. Let 'y{x),'y{y) € Ord. Then x sa y iff *7(x) sa *7(y), by Theorem 15.231 iff 
*7(x) ~ *j{y), by Theorem 14.41 iff *7(x) -|- *7(y) ~ 0, by Proposition 13.6^ 111). iff *7(x) -|- 
*7(y) $ 0) since *7(x),*7(y) are Conway's games, iff x -|- y ]); 0, by Theorem 15.231 and 
congruence of ~. If both x ^ and y ij^, then the thesis follows from Corollary 15.261 □ 

According to the above characterization, ~ discriminates between well-behaved and 
non-wellbehaved hypergames. Checking whether two well-behaved hypergames x, y are 
equivalent is particularly efficient, since a single game, x + y, has to be considered. For 
non-wellbehaved hypergames, it is sufficient to test x, y in well-founded canonical contexts. 
Efficient characterizations of the contextual equivalence for the whole class of hypergames, 
based on Definition 15.271 are explored in |HLR11| . 
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6. Comparison with Related Work and Directions for Future Work 

Loopy games. The theory of general mixed loopy games, where infinite plays can be either 
winning for L or for R, or draws, appears very complex. For instance, already for the case 
of fixed impartial games (where no draws are admitted), determinacy fails if the Axiom of 
Choice is assumed (see e.g. [Jech03j . Lemma 33.1). Notice that some encoding is necessary 
to cast in Conway's setting such a result. Namely, the straightforward representation of the 
infinite game on u)'^ would collapse to oo, i.e. the self-singleton. 

In iJ BCG82) . Chapter 11, a > relation is introduced for fixed loopy games, which is 
proved to be transitive. It allows to approximate the behavior of a loopy game, possibly 
with finite games. However, this technique works only if certain fixpoints exist. Such theory 
has been later further developed and revisited in other works, see e.g. |San02t[San02a| . 

Our theory allows to deal with the class of games where infinite plays are draws, namely 
free games in |BCG82| terminology, in a quite general and comprehensive way. In [HLRlla] , 
we use algebraic and coalgebraic methods to account for more general classes of games, such 
as mixed loopy games. 

Gaines and automata. The notion of hypergame that we have investigated in this paper 
is related to the notion of infinite game considered in the automata theoretic approach, 
originating in work of Church, Biichi, McNaughton and Rabin (see e.g. |Tho02j ) . In this 
approach, games are defined by the graphs of positions. L and R have different positions, 
in general, but L is always taken as first player. Only games with infinite plays are usually 
considered there. These games are fixed, i.e. no draws are admitted. Winning strategies 
are connected with automata, and also the problem of a (efficient) computation of such 
strategies is considered. Recently, non-losing strategies have been considered also in this 
setting, e.g. in the context of model checking for the ^-calculus, see JGLLS07) . We plan 
to pursue this approach. Notice that also in this case some encoding is necessary for 
representing such games as Conway's games to avoid the collapse into the self-singleton oo. 

Games for semantics of logics and programming languages. Game Semantics was introduced 
in the early 90's in the construction of the first fully complete model of Classical Multiplica- 
tive Linear Logic [A J94] . and of the first syntax-independent fully abstract model of PCF, 
by Abramsky-Jagadeesan-Malacaria, Hyland-Ong, and Nickau, independently. Came Se- 
mantics has been used for modeling a variety of programming languages and logical systems, 
and more recently for applications in computer- assisted verification and program analysis, 
[AGMO03] . In Game Semantics, 2-player games are considered, which can be encoded as 
Conway games, despite the different presentation. For more details see |A J94j . The key 
difference between the Game Semantics approach and our approach lies in the crucial defini- 
tion of Conway sum, which does not necessarily imply that projections in component games 
are correct plays, i.e. strictly alternating. On the contrary, all the operations on games, e.g. 
tensor product, linear implication, satisfy this condition. Furthermore, in Game Semantics, 
infinite plays are always considered as winning for one of the two players, as in the case of 
fixed games. A general framework based on coalgebras, encompassing both Conway's games 
and games used in Game Semantics, as well as other games, is presented in [HLRlla] . Such 
unifying framework allows us to capture the common nature of games arising in different 
settings. 
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Traced categories of games. In | Joy77j , Joyal showed how Conway (finite) games and win- 
ning strategies can be endowed with a structure of a traced category. This provides an alter- 
nate account of the contextual equivalence ~; namely, existence of a morphism between the 
corresponding games. When hypergames and non-losing strategies are considered, Joyal's 
categorical construction apparently does not work, since we lose closure under composition 
(this is related to the fact that our relation > is not transitive). In [HLRllj . generaliza- 
tions of Joyal's category to hypergames are investigated, based on the new notion balanced 
non-losing strategy. Interestingly, when this construction is extended to mixed loopy games 
(see [HLRlla] ) , the categorical equivalence coincides with the loopy equivalence of |BCG82j . 
However, a categorical construction capturing the contextual equivalence on hypergames is 
still missing. 

Games and coalgebras. In [BM96J . a simple coalgebraic notion of game is introduced and 
utilized. It is folklore that bisimilarity can be defined as a 2-player game, where one player 
tries to prove bisimilarity, while the other tries to disprove it, see e.g. |BM96j . After some 
encoding, this game turns out to be a fixed game in the sense of JB CG82] . where infinite 
plays are winning for the player who tries to prove bisimilarity. 

Notice that all our notions and methods could be given on graphs rather than graphs 
up-to bisimilarity. The former approach can be convenient in applications, because com- 
puting the minimal graph with respect to bisimilarity could be complex, however the latter 
approach is conceptually more perspicuous. 

Conumbers. Conway's numbers |Con76] amount to Conway's games x such that no member 
of X^ is ^ any member of X^, and all positions of a number are numbers. Thus, once we 
have defined hypergames and the relations >, ► , we can define the subclass of conumbers, 
together with suitable operations extending those on numbers. It would be interesting to 
investigate the properties of such a class of hypergames. An intriguing point is whether 
it is possible to define a partial order, since, as seen in this paper, the relation > is not 
transitive on hypergames. 

Compound games. In this paper, we have considered the (disjunctive) sum for building 
compound games. However, there are several different ways of combining games, which are 
analyzed in |Con76] . Chapter 14, for the case of finite games. It would be interesting to 
investigate such theory of compound games in the setting of hypergames. Similarly for the 
misere situation, where the winner is the player who does not perform the last move. 

Game equivalences. Equivalences on games and hypergames have been extensively inves- 
tigated in this paper. The contextual equivalence has been introduced and studied. In 
particular. Proposition 15.281 gives an alternative efficient characterization of the contextual 
equivalence for impartial hypergames. For general partizan hypergames, where we do not 
have an analogue of Grundy semantics, alternative efficient characterizations of contextual 
equivalence would be even more useful. This issue is investigated in [HLRllj . 
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Towards canonical forms for partizan games. The theory of impartial games, as shown in 
Section [5] is quite nice. In particular, impartial games admit canonical forms given by gen- 
eralized Grundy numbers. A question which naturally arises is about canonical forms for 
general partizan games. In |Con76j . Chapter 10, Conway studies canonical forms of general 
partizan games, and provides a technique for reducing a game to its canonical form, which 
works for finite games, i.e. games with only finitely many positions. This technique consists 
in simplifying a game, by eliminating all dominated and reversible positions. This provides 
canonical forms of Conway's games, which one can show to coincide with Grundy numbers, 
in the case of impartial games. The extension of the above technique to infinite Conway's 
games and more generally to hypergames appears to be problematic. A naive application 
of the same procedure to impartial hypergames fails, even in the case of hypergames repre- 
sentable by a finite graph and with finite Grundy number. We leave it as an open problem 
to investigate a generalization of the simplification procedure for hypergames. 
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